|
KMID : 0371019970300040719
|
|
Journal of Preventive Medicine and Public Health
1997 Volume.30 No. 4 p.719 ~ p.728
|
|
|
Reliability for Multiple Reviewers by using Loglinear Models
|
|
Park Byung-Joo
Lee Sung-Im
Lee Young-Jo
Kim Dong-Hyun
Kwon Ho-Jang
Bae Jong-Myon
Shin Myung-Hee
Ha Mi-Na
Han Sang-Hwan
|
|
|
Abstract
|
|
|
|
To guarantee the inter-reviewer reliability is very important in evaluating the quality of large number of clinical research papers by multiple reviewers. We cannot find reports on statistical methods for evaluating reliability for multiple raters in clinical research field. The purpose of this paper is to introduce the statistical methods focused on kappa statistic and five kinds of loglinear models for, which can be applied when evaluating the reliability of multiple raters. We have applied these methods to the result of a project, in which seven reviewers have evaluated the quality of 33 papers with regard to four aspects of paper contents including study, hypothesis, study design, study population, study method, data analysis and interpretation. Among the five loglinear models including Symmetry model, Conditional symmetry model, Quasi-symmetry model, Independence model, and Quasi-independence model, Quasi-symmetry model shows the best model of fitting. And the ´,level of reliability among seven reviewers revealed to be acceptable as meaningful.
|
|
|
KEYWORD
|
|
|
reliability, multiple reviewers, kappa, loglinear model
|
|
|
FullTexts / Linksout information
|
|
 
|
|
|
Listed journal information
|
|
  
|
|